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Abstract 

Datacenters {DCs) are deployed in a large scale to support the ever increasing demand for data 
processing to support various applications. The energy consumption of DCs becomes a critical issue. 
Powering DCs with renewable energy can effectively reduce the brown energy consumption and thus 
alleviates the energy consumption problem. Owing to geographical deployments of DCs, the renewable 
energy generation and the data processing demands usually vary in different DCs. Migrating virtual 
machines (VMs) among DCs according to the availability of renewable energy helps match the energy 
demands and the renewable energy generation in DCs, and thus maximizes the utilization of renewable 
energy. Since migrating VMs incurs additional traffic in the network, the VM migration is constrained by 
the network capacity. The inter-datacenter {inter-DC) VM migration with network capacity constraints is 
an NP-hard problem. In this paper, we propose two heuristic algorithms that approximate the optimal VM 
migration solution. Through extensive simulations, we show that the proposed algorithms, by migrating 
VM among DCs, can reduce up to 31% of brown energy consumption. 
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I. Introduction 

Cloud infrastructures are widely deployed to support various emerging applieations sueh as: 
Google App Engine, Mierosoft Window Live Serviee, IBM Blue Cloud, and Apple Mobile Me 
[fn . Large-seale data eenters (DCs), whieh are the fundamental engines for data proeessing, are 
the essential elements in eloud eomputing O, (Si. Information and Communieation Teehnology 
(ICT) is estimated to be responsible for about 14% of the worldwide energy eonsumption by 
2020 @1. The energy eonsumption of DCs aeeounts for nearly 25% of the total ICT energy 
eonsumption dH. Henee, the energy eonsumption of DCs beeomes an imperative problem. 

Renewable energy, whieh ineludes solar energy and wind power, produees 12.7% domestie 
eleetrieity of the United States in 2011 Q. Renewable energy will be widely adopted to reduee 
the brown energy eonsumption of ICT |0. For example. Parasol is a solar-powered DC [|71. 
In Parasol, GreenSwiteh, a management system, is designed to manage the work loads and the 
power supplies [jTl. The availability of renewable energy varies in different areas and ehanges 
over time. The work loads of DCs also vary in different areas and at different time. As a result, 
the renewable energy availability and energy demands in DCs usually mismateh with eaeh other. 
This mismateh leads to ineffieient renewable energy usage in DCs. To solve this problem, it 
is desirable to balanee the work loads among DCs aeeording to their green energy availability. 
Although the eurrent eloud eomputing solutions sueh as eloud bursting [[8l, VMware and F5 flU 
support inter-datacenter {inter-DC) virtual maehine {VM) migration, it is not elear how to migrate 
VM among renewable energy powered DCs to minimize their brown energy eonsumption. 

Elastie Optieal Networks {EONs), by employing orthogonal frequeney division multiplexing 
{OFDM) teehniques, not only provide a high network eapaeity but also enhanee the speetrum ef- 
fieieney beeause of the low speetrum granularity ifTOll . The granularity in EONs ean be 12.5 GHz 
or even mueh smaller ifTTI . Therefore, EONs are one of the promising networking teehnologies 
for inter-DC networks [fT^ . 

Powering DCs with renewable energy ean effeetively reduee the brown energy eonsumption, 
and thus alleviate green house gas emissions. DCs are usually eo-loeated with the renewable 
energy generation faeilities sueh as solar and wind farms [[T3]l . Sinee transmitting renewable 
energy via the power grid may introduee a signifieant power loss, it is desirable to maximize 
the utilization of renewable energy in the DC rather than transmitting the energy baek to the 
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power grid. In this paper, we investigate the renewable energy-aware inter-DC VM migration 
(RE-AIM) problem that optimizes the renewable energy utilization by migrating VMs among 
DCs. Fig. [H shows the arehiteeture of an inter-DC network. The vertiees in the graph stand for 
the optieal switches in EONs. DCs are connected to the optical switches via IP routers Q. These 
DCs are powered by hybrid energy including brown energy, solar energy, and wind energy. In 
migrating VMs among DCs, the background traffic from other applications are also considered 
in the network. For example, assume that DC 1 lacks renewable energy while DC 2 and DC 3 
have superfluous renewable energy. Some VMs can be migrated out of DC 1 in order to save 
brown energy. Because of the background traffic and the limited network resource, migrating 
VMs using different paths (Path 1 or Path 2) has different impacts on the network in terms of 
the probability of congesting the network. It is desirable to select a migration path with minimal 
impact on the network. 



Fig. 1. Inter-DC architecture. 


The rest of this paper is organized as follows. Section |n] describes the related work. Section 


*In this paper, we focus on the EONs. The design and optimization of the IP networks are beyond the scope of this paper. 
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Hm formulates the RE-AIM problem. Section |IV] briefly analyzes the property of the RE-AIM 
problem and proposes two heuristic algorithms to solve the problem. Section |V] demonstrates 
the viability of the proposed algorithms via extensive simulation results. Section |Vl] concludes 
the paper. 


II. Related Work 

Owing to the energy demands of DCs, many techniques and algorithms have been proposed 
to minimize the energy consumption of DCs lfT4ll . 

Eang et al. ifTSl presented a novel power management strategy for the DCs, and their target was 
to minimize the energy consumption of switches in a DC. Cavdar and Alagoz [[T^ surveyed the 
energy consumption of server and network devices of intra-DC networks, and showed that both 
computing resources and network elements should be designed with energy proportionality. In 
other words, it is better if the computing and networking devices can be designed with multiple 
sleeping states. A few green metrics are also provided by this survey, such as Power Usage 
Effectiveness (PUE) and Carbon Usage Effectiveness (CUE). 

Deng et al. ifTTIl presented five aspects of applying renewable energy in the DCs: the renewable 
energy generation model, the renewable energy prediction model, the planning of green DCs 
(i.e., various renewable options, avalabity of energy sources, different energy storage devices), 
the intra-DC work loads scheduling, and the inter-DC load balancing. They also discussed the 
research challenges of powering DCs with renewable energy. Ghamkhari and Mohsenian-Rad 
[fT4]| developed a mathematical model to capture the trade-off between the energy consumption 
of a data center and its revenue of offering Internet services. They proposed an algorithm to 
maximize the revenue of a DC by adapting the number of active servers according to the traffic 
profile. Gattulli et al. [fT^ proposed algorithms to reduce CO 2 emissions in DCs by balancing 
the loads according to the renewable energy generation. These algorithms optimize renewable 
energy utilization while maintaining a relatively low blocking probability. 

Mandal et al. (Sl studied green energy aware VM migration techniques to reduce the energy 
consumption of DCs. They proposed an algorithm to enhance the green energy utilization by 
migrating VMs according to the available green energy in DCs. However, they did not consider 
the network constraints while migrating VMs among DCs. In the optical networks, the available 
spectrum is limited. The large amount of traffic generated by the VM migration may congest 
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the optical networks and increase the blocking rate of the network. Therefore, it is important 
to consider the network constraints in migrating VMs. In this paper, we propose algorithms to 
solve the green energy aware inter-DC VM migration problem with network constraints. 

III. Problem Formulation 

In this section, we present the network model, the energy model, and the formulation of the 
RE-AIM problem. The key notations are summarized in Table HI 


TABLE I 

The Important Notations 


Symbol 

Definiton 

Ce 

The capacity of a link e £ E in terms of spectrum 


slots. 

Cs 

The capacity of a spectrum slot. 

Cm 

The maximum number of servers in the mth DC. 

c 

The maximum number of VMs can be supported 


in a server. 


The amount of renewable energy in the mth DC. 

9m 

The number of VMs in the mth DC. 

C/-m 

Per unit energy cost for the mth DC. 

Cm,k 

The required bandwidth for migrating the fcth VM 


in the mth DC. 

n 

The set of the migration requests. 

Qr 

The set of VMs migrated in the rth migration. 

K, 

The migration granularity. 

r.m 

Wp' 

The used spectrum slot ratio of the pth path in the 


rth migration from the mth DC. 

Wb 

The maximum network congestion ratio. 

Ps 

The maximum energy consumption of a server. 

V 

The power usage efficiency. 


A. Network Model 

We model the inter-DC network by a graph, E, B). Here, V, E and B are the node set, 
the link set and the spectrum slot set, respectively. The set of DC nodes is denoted as V. We 
assume that all DCs are powered by hybrid energy. We denote Vg as the set of DCs that does not 
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have sufficient renewable energy to support their work loads and as the set of DCs that has 
surplus renewable energy. During the migration, Vg and correspond to the two sets of DCs 
acting as the sources and destinations, respectively. We define k as the migration granularity, 
which determines the maximum routing resource that can be used in one migration to each DC. 

B. Energy Model 

We assume that there are Cm servers in the mth DC and each server can support up to ? VMs. 
The energy consumption of a server is Ps when it is active. A server is active as long as it hosts 
at least one active VM; otherwise, the server is in the idle state. Here, we assume that an idling 
server will be turned off and its energy consumption is zero. Then, is the number of 

active servers required in the mth DC Q. We denote rj as the power usage effectiveness, which 
is defined as the ratio of a DC’s total energy consumption (which includes the facility energy 
consumption for cooling, lighting, etc. lfT9l l to that of the servers in the DC. Given p, a DC’s 
total energy consumption is p ■ ps ■ We denote as the brown energy consumption in 

the mth DC. Then, 

= m&x{0, P-Ps-19m/ ( 1 ) 


C. Problem Formulation 

In the problem formulation, is ^ binary variable, x/^f = 1 indicates that the fcth VM in 
the mth DC is migrated using the p path with the /th spectrum slot as the starting spectrum slot. 
The objective of the RE-AIM problem is to minimize the total brown energy cost in all DCs with 
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the VM service constraints and the network resource constraints. The problem is formulated as: 


^p,f 

s.t. : 


^ ^ ' '^m 

m 

(2) 

VM service constraints : 



(3) 

m k p f m 


<CmyrneV, 

(4) 

k p f 


E EEEV/+ 

m'aVs k p f 

(5) 

k p f 


Network resource constraints : 


j^r,m 

^r m - pj_ ^ ^ r &TZ 

^ Ce 

(6) 

f{xlf)+Kxlf)<Ce 

(7) 

/(x”>*) + Kx”/)-/(x”>‘+‘)<o 

(8) 

f{i) + h{i) - f{j) < [2 - 5ij - y{i,j)]- 

(9) 

Fraax) 7^ J 


fU) + KJ) - /(*) < [1 + kj - yi'iJ)]- 

(10) 


Fmaxi 7^ J 

Here, Eqs. ([B])-® are the VM service constraints. Eq. @ constrains that all the VMs should be 
hosted in the DCs, while Eqs. @-® constrain that the total number of VMs in a DC should 
not exceed the DCs’ capacity. The network resource constraints are shown in Eqs. ®-(fT0l). 

Eq.® constrains the network congestion ratio to be less than wb, which is the maximum 
network congestion ratio allowed for routing in the network. In Eq. ®, tUp’'” is the spectrum 
slot ratio of the pth path in the rth migration from the mth DC, which is defined as the ratio 
of the number of occupied spectrum slots in the pth path to the total number of spectrum slots 
of this path. is defined as the number of spectrum slots used in the pth path for the rth 



migration from the mth DC. Eq.© is a link capacity constraint of the network; it constrains the 
bandwidth used in migrating VMs not to exceed the capacity of the network resource. Here, b{-) 
is the bandwidth requirement in terms of spectrum slots, and /(■) is the index of the starting 
spectrum slot of a path. For example, f{x^f) represents the starting spectrum slot index of 
the path, which is used by X^f- Eq.® is the spectrum non-overlapping constraint of a path 
used by two different VMs in one migration. This constraint must be met for each VM in every 
migration; if two VMs use the same spectrum slot in one migration, the total bandwidth allocated 
to the two VMs should not exceed the capacity of a spectrum slot; otherwise, each VM must use 
a unique spectrum slot. In the migration, the VMs are sorted in ascending order based on their 
bandwidth requirement. We assume the VMs are migrated according to an ascending order; for 
example, the {k + l)th VM is moved after the kth VM is migrated. 

Eqs. (l9l)- (fT0l) are the spectrum non-overlapping and the continuity constraints ll20l . This 
spectrum non-overlapping constraint is used for different paths. In these constraints, i and j 
represent two different paths used in the migration. Here, F^ax is the upper bound of the total 
bandwidth requirement in terms of spectrum slots. 5 ^^ (Vi 7^ j) is a Boolean variable defined in 
Eq. (HU), which equals 1 if the starting spectrum slot index of the ith path is smaller than that of 
the jth path; otherwise, it is 0. We define y{i,j) (Vi 7^ j) as a Boolean indicator, which equals 1 
if the ith path and the jth path in the migration have at least one common link; otherwise, it is 0. 
We give an example to illustrate these equations. If y{i,j) = 1 and 6ij = 1, Eq. dH) becomes Eq. 
(fTU) . which ensures the bandwidth non-overlapping constraint. Eq. (fTOl) is automatically satisfied 
in this case. 




11, f{i) < f{j) 
[ 0 , /(i) > /(j) 


f{i) + b{t) < /(j) 


( 11 ) 

( 12 ) 


When we provision spectrum slots for requests in the EONs, the path continuity constraint, 
spectrum continuity constraint and non-overlapping constraint must be considered. For the path 
continuity constraint, a lightpath must use the same subcarriers in the whole path for a request. 
For the spectrum continuity constraint, the used subcarriers must be continuous if a request needs 
more than one subcarriers. For the non-overlapping constraint, two different lightpaths must be 


assigned with different subearriers if they have one or more eommon links. Sinee we use a path 
based method to formulate the RE-AIM problem, the path eontinuity eonstraint of the network 
is already taken into aeeount. 

The main eontribution of this paper is eonsidering the network influenee on the migration when 
we minimize the brown energy eonsumption of the DCs. In other words, we want to impose a 
eontrollable effeet on the network in the migration that leads to less network eongestion. 

IV. Problem Analysis and Heuristic Algorithms 
A. Problem Analysis 

To solve the RE-AIM problem, both the energy eosts in DCs and the network resouree required 
for the migration should be eonsidered. Eor example, when a DC eonsumes brown energy, it is 
desirable to migrate some VMs to other DCs. The VM migration will introduee additional traffie 
to the network. To avoid eongesting the network, we have to optimize the number of VMs that 
will be migrated and seleet the routing path for the migration. Therefore, it is ehallenging to 
solve the RE-AIM, whieh is proven to be NP-hard. 

Lemma 1. The RE-AIM problem is NP-hard 

Proof: We prove that the RE-AIM problem is NP-hard by redueing any instanee of the 
multi-proeessor seheduling problem (MPS) into the RE-AIM problem. ■ 

In the RE-AIM problem, without eonsidering the network eonstraints, the optimal number of 
VMs hosted in the DCs ean be derived aeeording to the availability of the renewable energy. 
However, with the eonsideration of the network eonstraints and the baekground traffie, it is 
diffieult and impossible to solve the RE-AIM problem online. Eor the RE-AIM problem, many 
VMs are migrated from a set of DCs (souree DCs) to another set of DCs (destination DCs). 
Therefore, we ean model the VM migration problem as a manyeast problem. Sinee the RE-AIM 
problem is NP-hard, we propose heuristie algorithms to solve this problem. These algorithms 
determine whieh VM should be migrated to whieh DC and seleet a proper routing path in the 
network to avoid eongesting the network. We eonsider two network seenarios. The first one is a 
network with light traffie load. Under this network seenario, we design Manyeast with Shortest 
Path Routing (Manycast-SPR) algorithm for VM migrations. The seeond network seenario is a 
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network with heavy traffie load. In this case, we propose Manycast Least-Weight Path Routing 
(Manycast-LPR) for migrating VMs among DCs. 

B. Heuristic Algorithms For Light Work Loads 

When the network load is light, there are more available spectrum slots. It is easy to find a path 
with available spectrum slots for the migration requests. Then, a lower computing complexity 
algorithm is preferred. Manycast-SPR only uses the shortest path, and thus it is a very simple 
algorithm. Hence, Manycast-SPR is expected to provision the inter-DC VM migration requests 
in a network with light work loads. 

The Manycast-SPR algorithm, as shown in Alg. [H is to find the shortest routing path that 
satisfies the VM migration requirement and the network resource constraints. In the beginning, we 
input E, B), 0m and <Fm, and then calculate the optimal work loads distribution. Afterward, 
we get V, Vs and Vd. Then, we collect the migration requests R. Here, our algorithm splits 
the manycast requests into many anycast requests r E R. Now, we start to find a source DC s 
and a destination DC d for the request r. The migration will try to use the shortest path p from 
s to d; the request r is carried out if the network congestion constraint is satisfied; otherwise, 
the request is denied. Then, we update Vg and Vd for the next request. After many rounds of 
migration, if Vg or Vd is empty, or Eq. ® is not satisfied, the migration is completed. 

Details of the Manycast-SPR algorithm is described in Algorithm [T] Here, p(-) is a func¬ 
tion which targets to get the path for the migration. The complexity of Manycast-SPR is 
0{\B\\E\^\R\\Qr\\V\^Cm<i)- Here, 0{\Vfcm<i) is the complexity to determine the optimal work 
loads, 0{\B\) is the complexity to determine /, and 0{\lZ\\Qj.\) is the complexity in building the 
VM set for the migration. 0(|Ep) is the complexity of determining the path p for Manycast-SPR. 

C. Heuristic Algorithms For Heavy Work Loads 

When the work load of the network is heavy, the number of available spectrum slots in the 
network is limited. Since Manycast-SPR only uses the shortest path (one path) for routing, it is 
impossible for Manycast-SPR to find an available path and spectrum slots in this scenario. Then, 
Manycast-SPR may block the migration request, and leads to high brown energy consumption of 
DCs. Hence, we propose another algorithm Manycast-LPR to achieve better routing performance, 
that results in low brown energy consumption. Manycast-LPR checks iC-shortest paths from 


11 


the source node to the destination node, and picks up the idlest path to serve the requests. 
The requests will be provisioned with a higher probability by Manycast-LPR as compared to 
Manycast-SPR. In summary, Manycast-LPR is expected to provision the inter-DC VM migration 
requests under a heavy work load. It targets to find a path with more available spectrum slots 
at the expense of a higher complexity. 

Manycast-LPR, as shown in Alg. [2l is to find the least weight routing path that satisfies the 
VM migration requirement and the network resource constraints. The main difference between 
Manycast-LPR and Manycast-SPR is using different ways to find a path. For Manycast-SPR, 
it first determines the source node and the destination node. Manycast-LPR, however, finds the 
path first, then uses the path to find the source node and the destination node. The other steps 
are almost the same. Since Manycast-LPR should calculate the weights for all node pairs to find 
a path, it increases the complexity. 

Details of the Manycast-LPR algorithms is described in Algorithm [21 The complexity for 
Manycast-LPR is 0{K\B\\E\^\TZ\\Qr\\Vf‘Cm^). Here, p(-) is a function which targets to get the 
path for the migration. 0{\Vfcra‘i) is the complexity to determine the optimal work loads, 0(\B\) 
is the complexity to determine /, and 0{\R,\\Qr\) is the complexity in building the VM set for 
the migration. 0{K\E\^\V\) is the complexity of determining the path p for Manycast-LPR. The 
most complex part is to determine the set of VMs for the migration. 

V. Performance Evaluations 

We evaluate the proposed algorithms for the RE-AIM problem in this section. In order to 
make the RE-AIM problem simple, we assume migratory VMs can be completed in one time 
slot. The NSFNET topology, shown in Eig. [2l is used for the simulation. There are 14 nodes, 
and the DCs are located atV = {3,5, 8,10,12} [|2T]| . [|22]| . The DCs are assumed to be equipped 
with wind turbines and solar panels, which provide the DCs with renewable energy, as shown 
in Fig |2l The constant a is randomly generated from [1.6, 3.2] and represents the varying price 
of the electric grid. The capacity of a spectrum slot b is set to 12.5Gps. The maximum number 
of slots Ce is set to 300; 300 spectrum slots are available when the network is empty. Assume 

equals to 10; 10 VMs can be run in one server. K is set to 3, i.e., the maximum number of 
shortest paths that can be used in Manycast-EPR is 3. Without losing generality, the average 
energy consumption of a VM is assumed to be 1 unit, implying that ps equals to 10 units. The 


12 


Algorithm 1: Manycast with Shortest Path Routing 
Input : g{V, E, B), 0^ and ^rn'. 

Output: V, Qr, p(Qr), f(Qr) and E^j, r e R; 

1 Build V, Vs and by the the optimal work loads alloeation; 

2 Colleet manycast requests i?; 

3 while Vs and V^ are not empty do 

4 calculate the network congestion ratio for all p, and get wb', 

5 for all nodes s E Vs do 

6 find s with the max migratory VMs as the source node; 


7 

8 

9 

10 

11 

12 

13 

14 

15 


for all nodes d E Vd do 

find d with the max available renewable energy as the destination node; 

get the shortest path p(Qr) from s to d for the rth migration; 
build Qr for the rth migration according to p(Qr) and Eqs. (l9l)-(fT^: 
if Eq. ® is satisfied then 

path p{Qr) is used to migrate; 

find the start spectrum slot index f{Qr) in B ; 

get the allocated bandwidth E^j ; 

update Vs and Vd, 


16 

17 


else 

return; 


VM bandwidth requirement C,m,k is randomly selected from [1,14], which is convenient for the 
simulation. The migration requests are generated by the optimal work loads distribution which 
is calculated based on Om and <Em- The background traffic is randomly generated between node 
pairs in the network. The background traffic load is counted as an average of where A is 
an average arrival rate of the requests and - is the holding period of each request [|^ . Here, 
the background traffic arriving process is a poisson process, and the holding time is a negative 
exponential distribution. Parameters which are used for the evaluation are summarized in Table 
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Algorithm 2: Manycast with Least-weight Path Routing 
Input : g{V, E, B), 0^ and ^rn'. 

Output: V, Qr, p(Qr), f(Qr) and E^j, r e R; 

1 Build V, Vs and by the the optimal work loads alloeation; 

2 Colleet manycast requests i?; 

3 while Vs and V^ are not empty do 

4 calculate the network congestion ratio for all p, and get wb', 

5 for all nodes s E Vs do 

6 for all nodes d eV^ do 

7 build K-shortest path set V\ 

8 for path p eV do 

9 get path p(Qr) with the lowest congestion ratio for the rth migration; 


10 

11 

12 

13 

14 

15 

16 
17 


build Qr for the rth migration according to p(Qr) and Eqs. (l9l)-(fTO: 
if Eq. ® is satisfied then 

path p{Qr) is used to migrate; 

find the start spectrum slot index f{Qr) in B; 

get the allocated bandwidth E^j; 

update Vs and V^, 

else 

return; 


m 

We run the simulation for 150 times, and exclude the scenario with empty VM requests traffic 
load {Vs 7 ^ 0 & Vd 0). Fig. [3] shows the total cost of brown energy consumption 

of the strategy without using renewable energy, Manycast-SPR {k = 2) and Manycast-LPR 
{k = 2). Apparently, Manycast-SPR and Manycast-LPR can save brown energy substantially. 
Manycast-SPR saves about 15% cost of brown energy as compared with the strategy without 
migration. Manycast-LPR reduces up to 31% cost of brown energy as compared with the strategy 
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Fig. 2. NSFNET topology with renewable energy DCs. 


without migration. Manycast-LPR has better performanee beeause Manyeast-LPR employs the 
least weight path p of all node pairs for routing, while Manyeast-LPR engages only the short 
path p of one node pair. 

In order to obtain a better analysis, the running time of Manyeast-SPR (k = 2) and Manyeast- 
LPR (k = 2) are shown in Fig.|4l Manyeast-SPR spends less time than Manyeast-LPR, implying 
that Manyeast-SPR has a lower eomplexity and Manyeast-LPR has a higher eomputing eom- 
plexity. It also illustrates that the time and the final eost value is a trade-off in the evaluation. 
Manyeast-LPR is more eomplex and henee ineurs a lower brown energy eost. 

The results of Manyeast-SPR for various k are deseribed in Fig. |51 The eost of brown energy 
eonsumption keeps inereasing when the baekground traffie inereases, beeause high baekground 
traffie tends to eongest the network links and leads to more migration failures. Apparently, a 
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TABLE II 

Simulation Parameters 


Network topology 

NSFNET 

V 

{3, 5, 8, 10, 12} 

C 

10 VMs 

Cm 

1000 servers 

a = {ai,a 2 , 

{2.1, 2.5, 1.9, 2.8, 2} 

Om 

[0, 8000] 


[1000, 9000] 

Ps 

10 units, 1 unit for 1 VM in average 


[1,14] Gb/s 

Ce 

300 spectrum slots 

Cs 

12.5 Gbps 

K 

{2, 4, 8, 16} spectrum slots 

A 

{40, 80,120,160, 200, 240, 280, 320} 


small K brings more benefits than a big k in redueing the energy eost. 

Fig. 0 shows the results of Manyeast-LPR for various n, almost the same results as shown in 
Fig. [51 but the cost of the brown energy consumption is much less than that in Fig. [51 because 
Manyeast-LPR can easily find a path which has available bandwidth for migration. Obviously, 
Manyeast-LPR with k = 2 achieves the best result with the lowest cost of consumed brown 
energy. All these results illustrate that a small k leads to a lower cost of the brown energy 
consumption and a big k induces a higher cost of the brown energy consumption. This is 
because it is difficult to find a path with enough bandwidth for a big k, when the network has 
background traffic. A smaller n achieves a lower energy cost at the cost of higher complexity. 

Figs. [7] and [8] show the running time of Manycast-SPR and that of Manyeast-LPR with different 
K, respectively. We can observe that the computing time is decreased when the traffic load 
increases. For the same k with a given background traffic load, Manycast-SPR consumes more 
time than Manyeast-LPR does. For either of the two algorithms under a specific background 
traffic load, we can see that the running time is nearly halved when k is doubled. Hence, a smaller 
K, brings a better performance but takes longer time, and a larger k has worse performance with 
a shorter running time. 
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Fig. 3. Total brown energy cost comparison. 


VI. Conclusion 

Datacenters are widely deployed for the increasing demands of data processing and eloud 
eomputing. The energy eonsumption of DCs will take up 25% of the total ICT energy consump¬ 
tion by 2020. Powering DCs with renewable energy ean help save brown energy. However, the 
availability of renewable energy varies by locations and changes over time, and DCs’ work loads 
demands also vary by loeations and time, thus leading to the mismateh between the renewable 
energy supplies and the work loads demands in DCs. Inter-DC VM migration brings additional 
traffie to the network, and the VM mitigation is eonstrained by the network eapaeity, rendering 
inter-DC VM migration a great ehallenge. 

This paper addresses the emerging renewable energy-aware inter-DC VM migration problem. 
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Fig. 4. Running time comparison. 


The main contribution of this paper is to reduce the network influence on the migration while 
minimizing the brown energy consumption of the DCs. The RE-AIM problem is formulated and 
proven to be NP-hard. Two heuristic algorithms, Manycast-SPR and Manycast-LPR, have been 
proposed to solve the RE-AIM problem. Our results show that Manycast-SPR saves about 15% 
cost of brown energy as compared with the strategy without migration, while Manycast-EPR 
saves about 31% cost of brown energy as compared with the strategy without migration. The 
computing time of Manycast-EPR is longer than that of Manycast-SPR because the complexity of 
Manycast-EPR is higher than Manycast-SPR. In conclusion, we have demonstrated the viability 
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Fig. 5. Total brown energy cost of Manycast-SPR. 


of the proposed algorithms in minimizing brown energy eonsumption in inter-DC migration 
without eongesting the network. 
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